Least squares and shrinkage estimation under bimonotonicity constraints
نویسندگان
چکیده
In this paper we describe active set type algorithms for minimization of a smooth function under general order constraints, an important case being functions on the set of bimonotone r × s matrices. These algorithms can be used, for instance, to estimate a bimonotone regression function via least squares or (a smooth approximation of) least absolute deviations. Another application is shrinkage estimation in image denoising or, more generally, regression problems with two ordinal factors after representing the data in a suitable basis which is indexed by pairs (i, j) ∈ {1, . . . , r} × {1, . . . , s}. Various numerical examples illustrate our methods.
منابع مشابه
On the degrees of freedom in shrinkage estimation
We study the degrees of freedom in shrinkage estimation of the regression coefficients. Generalizing the idea of the Lasso, we consider the problem of estimating the coefficients by the projection of the ordinary least squares estimator onto a closed convex set. Then an unbiased estimator of the degrees of freedom is derived in terms of geometric quantities under a smoothness condition on the b...
متن کاملShrinkage Estimation and Prediction for Time Series
For independent samples, shrinkage estimation theory has been developed systematically. Although shrinkage estimators are biased, they improve the MSE of unbiased ones. In view of this, we will develop shrinkage estimation theory and prediction for dependent samples. First, we propose a shrinkage estimator for the coefficients of AR model, which improves the MSE of the least squares estimator. ...
متن کاملUnbiased Shrinkage Estimation
Shrinkage estimation usually reduces variance at the cost of bias. But when we care only about some parameters of a model, I show that we can reduce variance without incurring bias if we have additional information about the distribution of covariates. In a linear regression model with homoscedastic Normal noise, I consider shrinkage estimation of the nuisance parameters associated with control...
متن کاملSuperefficient Estimation of Multivariate Trend
The question of recovering a multiband signal from noisy observations motivates a model in which the multivariate data points consist of an unknown deterministic trend Ξ observed with multivariate Gaussian errors. A cognate random trend model suggests affine shrinkage estimators Ξ̂A and Ξ̂B for Ξ, which are related to an extended Efron-Morris estimator. When represented canonically, Ξ̂A performs c...
متن کاملSupereecient Estimation of Multivariate Trend
The question of recovering a multiband signal from noisy observations motivates a model in which the multivariate data points consist of an unknown deter-ministic trend observed with multivariate Gaussian errors. A cognate random trend model suggests aane shrinkage estimators ^ A and ^ B for , which are related to an extended Efron-Morris estimator. When represented canonically, ^ A performs co...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Statistics and Computing
دوره 20 شماره
صفحات -
تاریخ انتشار 2010